In farming systems, harvesting operations are tedious, time- and resource-consuming tasks. Based on this, deploying a fleet of autonomous robots to work alongside farmworkers may provide vast productivity and logistics benefits. Then, an intelligent robotic system should monitor human behavior, identify the ongoing activities and anticipate the worker's needs. In this work, the main contribution consists of creating a benchmark model for video-based human pickers detection, classifying their activities to serve in harvesting operations for different agricultural scenarios. Our solution uses the combination of a Mask Region-based Convolutional Neural Network (Mask R-CNN) for object detection and optical flow for motion estimation with newly added statistical attributes of flow motion descriptors, named as Correlation Sensitivity (CS). A classification criterion is defined based on the Kernel Density Estimation (KDE) analysis and K-means clustering algorithm, which are implemented upon in-house collected dataset from different crop fields like strawberry polytunnels and apple tree orchards. The proposed framework is quantitatively analyzed using sensitivity, specificity, and accuracy measures and shows satisfactory results amidst various dataset challenges such as lighting variation, blur, and occlusions.

A bowl of salad is a beautiful collection of human ingenuity. The lettuce requires its own specialized agricultural process, as do the tomatoes, as do the garbanzo beans. Then comes the simple act of pulling these ingredients out of the ground, a challenge our dextrous human hands complete with ease. This is why roboticists are creating crop-specific machines to harvest fruits and veggies. There's the robot that harvests lettuce with a knife made of water.

With strawberry picking season well under way - but migrant labour in short supply in several countries - we look at the various robots being developed around the world to help producers harvest this most popular fruit. Next time you buy strawberries take a look a good look in the punnet. Do the berries still have the stem attached or has it been plucked off leaving only the green hat of leaves called the calyx? You may not think that matters, but it's a key consideration for growers as they contemplate the merits of a range of robotic prototypes that promise to pick strawberries as fast and as carefully as humans. Whether the berry is plucked or whether the stalk is snipped through and kept attached is one critical difference between the concepts that Spanish, Belgian, British and US engineers are testing, ready to roll out in fields as soon as next year.

There is growing concern about the impact of automation on employment - or in crude terms - the threat that robots will eat our jobs. But if you want to see how important robotics and artificial intelligence can be to a business Ocado is a good place to start. "Without it we simply couldn't do what we do at this scale," the online retailer's chief technology officer Paul Clarke told me. With margins in the supermarket business wafer thin, continually bearing down on costs and waste has been vital. At its Hatfield distribution centre I got a glimpse of how far the process of automating the sorting of thousands of grocery orders has come.